Infinite horizon risk-sensitive control of diffusions without any blanket stability assumptions

نویسندگان

  • Ari Arapostathis
  • Anup Biswas
چکیده

We consider the infinite horizon risk-sensitive problem for nondegenerate diffusions with a compact action space, and controlled through the drift. We only impose a structural assumption on the running cost function, namely near-monotonicity, and show that there always exists a solution to the risk-sensitive Hamilton–Jacobi–Bellman (HJB) equation, and that any minimizer in the Hamiltonian is optimal in the class of stationary Markov controls. Under the additional hypothesis that the coefficients of the diffusion are bounded, and satisfy a condition that limits (even though it still allows) transient behavior, we show that any minimizer in the Hamiltonian is optimal in the class of all admissible controls. In addition, we present a sufficient condition, under which the solution of the HJB is unique (up to a multiplicative constant), and establish the usual verification result. We also present some new results concerning the multiplicative Poisson equation for elliptic operators in R.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On the Non-Uniqueness of Solutions to the Average Cost HJB for Controlled Diffusions with Near-Monotone Costs

We present a theorem for verification of optimality of controlled diffusions under the average cost criterion with near-monotone running cost, without invoking any blanket stability assumptions. The implications of this result to the policy iteration algorithm are also discussed. Index Terms controlled diffusions, near-monotone costs, Hamilton–Jacobi–Bellman equation, policy iteration

متن کامل

Uniform Recurrence Properties of Controlled Diffusions and Applications to Optimal Control

In this paper we address an open problem which was stated in [A. Arapostathis et al., SIAM J. Control Optim., 31 (1993), pp. 282–344] in the context of discrete-time controlled Markov chains with a compact action space. It asked whether the associated invariant probability distributions are necessarily tight if all stationary Markov policies are stable, in other words if the corresponding chain...

متن کامل

Impulse Control of Multidimensional Jump Diffusions in Finite Time Horizon

This paper analyzes a class of impulse control problems for multidimensional jump diffusions in the finite time horizon. Following the basic mathematical setup from Stroock and Varadhan [Multidimensional Diffusion Processes, Springer-Verlag, Heidelberg, 2006], this paper first establishes rigorously an appropriate form of the dynamic programming principle. It then shows that the value function ...

متن کامل

Classical Solutions of Linear Regulatorfor Degenerate Diffusions

The usual framework of control is the one given in probably the most studied control problem, stochastic regulator control problem, which deals with minimizing a performance index of a system governed by a set of differential equations. The stochastic linear regulator problem has been studied by many authors including Bensoussan [4], Fleming and Soner [9] for nondegenerate diffusions. Da Prato ...

متن کامل

Stability of a truncated infinite constrained receding horizon scheme: the general discrete nonlinear case

-Some results concerning the constrained receding horizon formulation with infinite and truncated prediction horizon are presented. In this formulation a distinction is made between prediction and control horizons. The main result is a generalization of a known fact for linear systems, namely that, under certain technical requirements, the asymptotic stability of the above formulation holds for...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017